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1 Introduction 

Let {Q, A, ji) denote a probability space and T : — )• i7 an invertible, ergodic measure 
preserving transformation. Thus, T has a measurable inverse, ^\T~^{Ay\ = fi{A) for all 
A E A, and the only A E A for which T~'^{A) = A have measure or 1. If / : 1] — t- M 
is any measurable function, then Xj = / o T*, i E 1j, defines a strictly stationary process. 
Conversely, any strictly stationary ergodic process can be represented in this form on a 
sequence space. Suppose that the process Xj = / o T* is adapted to a filtration (J-i)igz 
for which J-^+i = T~^J^i for all i E 1^. This is always the case with J-", = cr{Xj : j < i}, 
but other choices may be more convenient in other examples. Finally, let ■) denote a 
regular conditional probability on B = cr{Xi, X2, ■ ■ ■} given J'q, [12j, p. 358 — 64, and write 
fi^ = fi{ijj] ■); thus, ■) is a probability measure for each u E Q and B) is (a version 
of) fi{B\J^o} for each B e B. 

Next, let U'g = go T for i G Z and g G L^{ij), so that Xi = U'f, and let S'„(/) = 
X, + ■■■ + Xr, = Uf + ■■■ + U^f for n > 1. If / G LUfi) = {g e L\fi) : J^gd^i = 0}, 
so that {Xi)i(zz is a centered process with finite variance, then it is natural to ask whether 
Sn{f)/y/n is asymptotically normal as n — > 00. The question has several forms. Let Gn 
denote the distribution function of Sn{f)/y/n, Gn{z) = ji{Sn{f) / ^/n < z} for z G M, and 
write Gn{uJ', z) = i^u}{Sn{f) I ^/n < z} for the conditional distribution function given J-q. 
If Gn converges to a distribution G, say, denoted G„ =^ G, then the convergence is said 
to be annealed. If there is single (non-random) distribution G for which Gn{uJ] ■) ^ G for 
a.e. u, then the convergence is said to be quenched with respect to J-q or simply J^Q-Quenched 
(Derriennic and Lin [6]). There is another possibility in which almost everywhere convergence 
is replaced by convergence in probability. We will call such convergence weakly J-'o- quenched. 
Necessary and sufficient conditions for weakly quenched convergence may be found in [1] 
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and [16]. Conditions for fully quenched convergence are more delicate, for example [2], [3] 
and [m. 

Interest in quenched limits comes in part from additive functionals of a Markov Chain 
that does not start in the stationary distribution. For example, in Markov Chain Monte 
Carlo, the stationary distribution vr contains an unknown normalizing constant, and the 
purpose is to generate random variables having approximately the distribution tt. Thus, 
let ■ ■ ■ W-i, Wq, Wi, ■ ■ ■ denote a stationary ergodic Markov Chain with stationary marginal 
distribution vr and consider an additive functional Sn = g(Wi) + - ■ ■+giWn) where g G -^^^(vr). 
This is a stationary process and, so, can be represented in the form = / o T'^ as above. 
If J-jfc = a{Wi : i < k}, then the question of quenched convergence is equivalent to asking 
whether the conditional distribution of Sn/ ^/n given Wq = w converges for a.e. w (vr). 

Denote the norm in U'{^) by || ■ ||p; write E for both expectation and conditional ex- 
pectation with respect to /x; and let be the set of J-q measurable g G L'^{'k) for which 
E{Ug\J^Q) = 0. is called the martingale difference space because U^g,i G Z, are martin- 
gale differences for any g E Ai. An / G L'^ifi) is said to admit an co-boundary if there 
is an m G and a (7 G U\^f) for which f = m + g — Ug. It is known that the existence 
of an co-boundary implies the annealed version the the Central Limit Theorem and the 
existence of an co-boundary the quenched version. In Theorem 2 we show that the exis- 
tence of an co-boundary does not imply the quenched version. In Theorem 1 it is shown 
that the condition ([T]) introduced by Hannan [8] implies that the conditional distributions 
of {Sn — E{Sn\J^o)}/ Vn converge to a normal distribution w.p.l. 

2 The Martingale Case 

Much of the recent progress on the central limit question for sums of stationary processes 
has relied on approximation by martingales. So, the case in which Sn{f) is a martingale is 
considered first. Some preparation is necessary. Recall that if (? G L^ifJ'), then U^g/n — )■ 
w.p.l by the Pointwise Ergodic Theorem (since U'^g = Sn{g) — Sn-i{g)). So, if G L'^ifi), 
then U^g/ y/n — )■ w.p.l. Next, recall Mc Leish's conditions for the Martingale Central Limit 
Theorem [13], as refined by Lachout [IT]: Let X„j-, 1 < j < n, be martingale differences 
defined on a probability space An, Pn) for each n. If 

(i) E;=l^^,,^^"^^ 

(ii) V e > 0, P„[maxj<„ > e] ^ 0, 

(iii) sup„>i E„[maXj<„X2 < 00, 

then Xn^i + - ■ ■+Xn^n =^ Normal[0, a^] (that is, the distribution function of the sum converges 
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weakly to the normal distribution with mean and variance o"^.) Lachout [Tl] showed that 
(ii) and (iii) could be replaced by 

(iv) E„[maxj<„ \X„j\] 0. 

Lemma 1 If Xn,j = / o /y/n, where f G L'^ifJ^), then (iv) holds. 

Proof. Since / G L'^{P), it is clear that liuin^oo U"" f / ^/n = w.p.l (/i) and, therefore, 
that lim„_j.oo niaxj<„ \ U^ f\/y/n = w.p.l. {^S) for a.e. u. Let 



A = sup max \Xn , | and / = sup 



n>l l<i<n n>l V U 

Then X* < /* clearly, and > A} < \\f\\ll\^ for A > 0, by the Maximal Ergodic 

Theorem, QJ, p. 318. So, /* G and, therefore, X* G L^{fi^) for a.e. w. Condition (iv) 

then follows from the Dominated Convergence Theorem, applied conditionally. <C> 

Proposition 1 // / G Ai, then Gn{u}; ■) converges to the normal distribution with mean 
and variance II/II2 for a.e. u. 



Proof Equivalent results are estabhshed in [TO], [15], and [16], but are not isolated there. 
A proof is included here for completeness. Our proof, at least, differs from the arguments of 
[To] , [T5] . and [16]. Let Xnj = f /y/n, I < j < n. Then X„j are martingale differences 
with respect to fi^j for a.e. u, by the smoothing property of conditional expectation, [Ij, 
p. 448. So, it suffices to show that (i) and (iv) hold with P„ = /ij^ for a.e. u. That (iv) 
is satisfied was shown in Lemma [TJ For (i), it follows directly from the Pointwise Ergodic 
Theorem that 



'^WfWl 



w.p.l (/i) and, therefore, w.p.l (/i^) for a.e. 00 (/x). So, (i) is satisfied for the measures for 
a.e. CO. <C> 

Corollary 1 If f admits a L'^-coboundary, say f = m + g — Ug, where m E Ai and and 
g G L'^i^jj), then Gn{ou; ■) =^ Normal[0, ||m||2] for a.e.. 

Proof Since S'„(/) = Sn{rn) + Ug — U^^^g = Snijn) + o{y/n) w.p.l, the corollary follows 
from Slutzky's Theorem, applied conditionally. <) 
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3 Hannan's Theorem 



Write E^{g) = E{g\J^i) and P^g = E^{g) — E^~^{g) for g G L^ijJ.) and observe that the 
restrictions of each E'^ and Pi are projections on L?'{^). Hannan [8j has shown that if 
/ G is J-Q measurable, E{f\F^oo) = 0, and 



then Sn{f)/y/n =^ Normal[0, ||m||2], where m = Yl^o^oU'^f- Volny and Woodroofe p3] 
show by example that the convergence need not be quenched. However, 

Theorem 1 // / G Lq{^) is J^Q-measurable, E{f\J^^oo) = and X]i<o ll-^^/lb < ^> ^hen 
the conditional distribution of {Sn{f) — E'^[Sn{f)]}/y/n given J-q converges to a normal 
distribution w.p.l. 

Proof. The easily verified relations E^{U^ f) = U^Ei_jf and Pi{U^ f) = U^P-i^jf are used 
in the proof. Letting gn = PoU~^Sn{f), 

n 

Snif) - E'[Sn{f)] = J^^ASnif) " S,.,{f)] 

i=i 

n n 

i=i i=i 



So, 

S,.(/) - -B»[S,.(/)1 



n ^ — ' •■" 



where F„j = gn-j+i/ y/n. The Ynj are martingale differences, since E^ ^[U^ gn~j+i] = 
gn-j+i = 0. So, it suffices to show that conditions (i) and (iv) of Proposition [1] 
hold w.p.l (yu). That (iv) is satisfied follows from Lemma [TJ For (i) first observe that 
\9n\ < Er=i \PoU'f\ = K say, and \\hh < EZi \\PoU'f\\ = EZi \\P-kfl which is finite by 
assumption. So, gn converges to m = J2T=i PoU^f w.p.l and in L'^{P), i?[sup„>;^ Is'np] < oo, 
and 

n 1 " 



n 

i=i i=i 



by (a simple application of) the The Pointwise Ergodic Theorem. See Lemma [2] below. (} 

Lemma 2 If gn are measurable, gn ^ 9 a-c, and sup„>;^ \gn\ is integrable, then 



1 " f 
-y^U^9n~k+i^ / 9dP w.p.l. 
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Proof. There is no loss of generality in supposing that g = 0. Let hm = sup„>^ \gn\- 
Then U^hi = o{n) w.p.l, since hi is integrable, and 

-Vf/^(?„_fc+i <- V?7^'/i„ + -Vf/"-'=+i/ii^ / h^dP 

k=l k=l k=l -^^^ 

for any m > 1. The lemma follows since the right side may be made arbitrarily small by 
taking m sufficiently large. <) 
A result equivalent to Theorem [1] appears in [3] ; the two results were obtained indepen- 
dently. 



4 Co-boundaries 

In this section it is shown that the existence of an co-boundary does not imply the 
quenched version of the central limit theorem. The same construction shows that a condition 
suggested by Heyde [9] does not imply quenched convergence. 

Theorem 2 There is a dynamical system {Q, A, ^,T) , an f G and a g G L^ilA for 

which: 

(a) f = 9- Ug; 

(h) limsup„^^E°[5„(/)]/v^> 1 w.p.l; 

and Ml, M2, ■ ■ ■ be strictly increasing sequences of positive integers 



Proof Let 4,4, 
for which 



E 

k=l 



1 ^,WM.„, 



< 00. 



(2) 



If ([2]) holds for Mk then it also holds with replaced by V 2ik, and we will suppose 
that Mfc > 2ik for all k. Let be random variables for which U^Ck = 6^0 T\ z G Z, k E N 
are independent. 



with probability 
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tfc 2kMk 
each, and Ck = otherwise; and let J^j = a{Wek '. i ^ j, k > 1}. Observe that ||efc||i = 
l/kik\/Mk and ||efc||2 = '^/kil for k > 1. If 4 is any sequence for which 1/y/kik summable, 
then (ED holds with Mq = 1 and = kilMk-i for A; > 1. 

To construct / and g and verify (a), first let A^^ = Mi -|- ■ ■ ■ -|- M^ and observe that 

Nk-i < kMk-i = o{Mk) as 00 by (ED, so that Nk ~ M^. Next, let hk = e^H hf/^'="^efc, 

and 



',-1 



24-1 



fk = hk- U'^hk = J2 U'ek 



(3) 



i=0 
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Then \\fk\\2 = 2£fc||efc|p = 2/k£k. So, ||/a:||2 is summable by ([2]) and, therefore, / = 
Er=i U-'^'^fk e L^fi). Next, \etgk = hk + --- + U'^-'h. Then - Ugt = hk- U'^h = fk, 
and llf^fclli < 4||^fc||i < ^fcllcfcili = d-k/ky/Mk, which is also summable by ([2]). So, g = 
Yl'kLi^~^''9k ^ L^if^) ^iid f = g — Ug, estabhshing (a). For later reference, observe that 
Snif) = Ug- U^+^g and 



4-14-1 24-2 

i=0 i=0 r=0 

where c^^r = {r + 1) for < r < 4 ~ 1 and c^^r = (24 — 1 — t) for ik ^ 1^ ^ 24 — 2. 
To verify (b) first observe that E^{U"'g) = I{n) + n{n), where 



(4) 



I{n) 



U^-'^'gu if Nu-i <n<Nk-2^k + 2 

EiV" Cfc,.t/^+"-^'=efc if iV, - 24 + 2 < n < iVfc 



and 



n{n) =Y.^' 

j=k+l 

for Nk-i < n < Nk- It will be shown that 



■n-Ni 



'9j 



for any e > and 



max I(n) > (1 — e)\/Nk, i.o. 



max //(n) 7^ i.o 

Nk_^<n<Nk 



Assertion (b) then follows from E^[Sn{f)] = Ug- E^lW'+^g]. 

To estabhsh ([5]), let A„ be the event that f/"+^'=-i~^'=efc = • 
for < i 7^ 4 - 1 < 24 - 2 for A^'^^i < n < A^'fc. If e > 0, then 



(5) 



(6) 



OTJik and U'^+'-^'^ek 



Affc-24+2 

11 AnC\ max 4(n) > (l-e)v/A^ 

ri=Affc_i+l 



for all large k, since A^^^ ~ M^. Then from (|2]) and the Bonferoni Inequalities, [7], p. 100 

(A^fc-24+2 \ Affc-24+2 Arfe-24+2 n-1 

"=A'fe-i + l / n=Affc-i+2 n=Affe_i+lm=Affc_i+l 

H 24-2 



> (AT, - Nk^i - 24 + 2) 



2A;M. 



1 - 



1 



kMk 



2 r 



1 24-2 



1 - 



That ([5]) holds, then follows from the Borel Cantelli Lemmas, since the events ^n='i^k''i+'i-^"' 
are independent. 

For (EI) simply observe that 



P 



max W'^^gA > 

Nk-i<n<Nk 



for j > k and 



CO oo 



fc=l j=fc+l ^ J ' j=2 ■> 
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which is finite (E]). So, (E]) also follows from the Borel Cantelli Lemmas. <) 
Recall that M. denotes the martingale difference space. Recall too the Convergence 
of Types Theorem, [12J, p. 203: Let an > 0, bn & K, and let Yn be a random variables. If 
Yn =^ Y , and anYn + bn =^ Z , where Y has a non- degenerate distribution, then a = lim„_>oo CLn 
and b = lim„_>oo bn exist, and Z =^*^* aY + b. 

Corollary 2 // m G A^, then Sn{m + f)/y/n ^ Normal[0, ||m||2], but the convergence is 
not quenched. 

Proof. Write 

Snim + f) Snim) , S„(/)-E0(5„(/)) , E'iSnif)) 



n yjn 

say, and observe that z/„ is J-Q-measurable. By Proposition [1] the conditional distribution of 
Yn^\ given converges to Normal[0, Ump]. In this casel^,2{5'„(/) — -E'°[S'„(/)]}/v^ and 
J-Q are independent. So, the conditional distribution of Y^^^ is the same as its unconditional 
distribution which converges to the degenerate distribution at by part (a) of the Theorem. 
It follows that the conditional distribution of F„ = F^^i + Y^;}, converges to the normal distri- 
bution with mean and variance HmUl. That the conditional distribution of Sn{m + f^j \fn 
does not converge to Normal [0, then follows from the Convergence of Types Theorem 

in the case m 7^ 0. If m = 0, then Gn{uj] z) = Fn[z — E^(S){u)], where F„ denotes the 
uncondtional distribution of Yn. It then follows from (b) that liminf„^oo z) = for 

0<z< 1/2. 
Heyde [9] showed that the CLT is true under a slightly weaker condition than Hannan's, 

m = yPoWf and \\m\\l = Urn ^^^^^^ . (7) 
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The last corollary shows that the / constructed in Theorem [2] satisfies ([7]), so that ([7]) does not 
imply quenched convergence either. That ([7]) does not imply the weak invariance principle 
was shown in [5J 

Corollary 3 If £k = 2^ , then the f constructed in TheoremlE satisfies ^ with m = 0. 

Proof. Since / is J-Q-measurable, the sum on the left side of ([7]) is lim„_^oo -Po'S'n(/)- If 
n > 1 then, using (jlj), 



Ck,Nk-nek if Nk - 2ik + 2 < n < Nk 
otherwise 



Let k = knhe the unique integer for which Nk-i < n < Nk- Then S'„(/) = -Pot^"~^'°5'Affc and 
||-Po'S'n(/) II2 ^ 2£^l|6fc||2 = 2/A; — 7- as n — 7- 00. Thus the sum converges to m = 0. 
For the second part of ([7]), observe that 



nA£i, — 1 



r=0 



r=nV£i.-l 



So, 



k=l 



■nA4-l 



■r=0 



k=l 



n+4-1 



.r=nvek-i 



00 nA^fc — 1 



2 °° II 

k=l r=0 k=l r=7iV^fe-l 



and, therefore. 



Mk 



ik<n ik>n ^fc<" ^fc>" 

Suppose now that £fc = 2^^ and let m„ = log2(Ti). Then the last term is at most 



k<i, 



k<m,n 



nir. 



k>mn 



as required in ((Tj). <) 
The proofs of Theorem [2] and Corollary [3] have been adapted and simplified from [5] 
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